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Abstract 



This is a report about the first two stages of a four-stage 
project designed to develop procedures to assess the accomplish- 
ments of applicants to graduate school* In the first stage, trial 
instruments were developed after thoroughly reviewing other attempts 
at assessing accomplishments and carefully considering the issues 
involved* Three prototypes were developed based on three approaches: 
a checklist approach, a semi-documented approach, and a CAEL-like 
open-ended portfolio approach* In the second stage, an instrument 
was developed that was designed to meet the operational and conceptual 
requirements of an inventory of documented accomplishments for 
graduate selection using as many of the positive features of earlier 
approaches in as simple a format as possible* This version was 
reviewed by a diverse group of people concerned with graduate 
admissions for the purpose of finding answers to the following 
questions: 

(1) How open-ended should the procedures be? 

(2) How should the quality of accomplishments be evaluated? 

(3) What should be the nature of ^ the content? 

(4) What is the best strategy for documentation? 

(5) What is the best mode of delivery? 

The final version represents the best balance we could devise 
among various answers to this question* In the third stage, the 
procedures will be tried out in a sample of graduate departments* 
The practical problem of administering, checking, and summarizing 
information obtained from the instrument would be considered as 
well as the technical issues concerning the validity of items, 
utility of the instrument, accuracy, and short-term validity* 
The fourth stage would entail a broader instrument tryout and the 
long-term predictive validity of the assessment instrument would 
be examined against a variety of criteria of graduate school success* 
These criteria would need to be carefully constv'ucted after thoroughly 
examining the meaning of short- and long-term success in the graduate 
school setting* In the fourth stage, operationally .feasible proce** 
dures would be refined for possible use by the Graduate Record 
Examinations Baord and/or by graduate schools* 

The work of the first two phases of this project is described 
in Part I of this report* 

The literature bearing on the prediction of high level accomplish- 
ment from inventories assessing earlier accomplishments is reviewed 
in terms of its salience for graduate admissions in Part II* 

Part III i:epro<luce& the instruisent that i& being used in the 
third stage of the project* 
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Part I: Development of the Inventory 



Leonard L* Baird 



This project is based on the assumption that a basic goal 
of graduate selection procedures is to select students who are 
likely to be productive, to be creative, to provide leadership, 
and to make a contribution to their fields* L'lany graduate departments' 
admissions comic'ttees feel the need for improved ways of assessing 
the out-of-'class learning and accomplishments of students so they 
can select students more likely zo be outstanding graduate students 
and who will eventually contribute most to the field* Thus, one 
purpose of the project is to develop comprehensive, concise, and 
accurate descriptions of the significant accomplishments of applicants^ 
particularly when those accomplishments are not reflected in currently 
available assessments or application materials* The rationale is 
tnat a pattern of significant, self -initiated accomplishments 
frequently reflects the sort of motivation and interest that cause a 
person to persist through training and to achieve more in professional 
work* 

A second purpose of the project is to broaden recognition of 
alternate foniis of talent* There is a need to assess different 
types of talent somewhat removed from purely academic ability* 
Such talents might include the ability to write expressively and 
forcefully, the intuition needed to devise a scientific experiment, 
organizational ability and technical inventiveness* Such broadening 
can have several desirable effects* One is to facilitate the better 
use of human resources^ especially in recognition of the fact that 
many types of talent and competence are Important and necessary in a 
well*functioning society* Another is to improve educational opportunity 
through placing appropriate value on the diverse talents more likely 
to be found in a diverse group of potential students* 

A third purpose is to provide graduate admissions committees 
^vith more appropriate selection information in order to better 
evaluate the accomplishments of students with special characteristics 
or preparation: older students^ minority students^ students 
from low income families, and students from unconventional programs* 
l^any types of relevant information are available through current 
admissions procedures, but they often lack the salience of test 
scores or grade averages and are likely to be overlooked without a 
sysitematic reporting procedure* A related objective is to provide 
students with a better opportunity to present evidence of talents 
that he or she may feel are personally significant and worthy of 
attention* 
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Of courset a great variety of approaches are possible to 
achieve trmse purposes, and, in fact, several have been tried out 
ia various contexts* In the first stage at this project, trial 
instruments were developed after thoroughly reviewing previous 
attempts at assessing accoinpllshiaents and carefully considering 
the issues involved* In the second stage, a preliminary instrument 
was developed that was designed to meet the operational and conceptual 
requirements of an inventory of documented accomplishments for 
graduate selection using as many of the positive features of earlier 
approaches in as simple a format as possible* The following sections 
describe the work of the first two stages* 



Work of Phase 1 

In tne first stage, three approaches — tne checklist approacn, 
tne semi-documented approach, and the portfolio approach-^-were 
examined* The checklist approacn consists of lists of irems that 
represent accomplisnments in various areas of activities* The 
Items asked students to simply check each item which described 
something they tiad accomplished, for example: ''Gave an original 
paper at a scientific meeting sponsored by a professional society," 
and **Had poems, stories, or articles published in a public newspaper 
or magazine or in a state or national college anthology*'^ 

The semi ^documented approach also asked for specific accomplish- 
ments, but requested greater detail* For example, an item read: 
''Have you ever won a prize or an award for some type of original 
art work?" Students responding "yes** are then asked to write in 
the nature of the work, the nase of the organization awarding the 
prize, and tue time and place of the award* 

The portfolio approacn asks students to assemble materials" 
products, writings, letters, copies of records, etc*— and organize 
them in a standard format so that their educational merit can be 
judged* 

The research bearing on the technical adequacy of these 
approaches was studied and their appropriateness for graduate 
admissions work was examined** Comparisons of the three approaches 
showed that each had advantages and disadvantages* The qualities of 
each approach could not readily be combined in a single instrument* 
Therefore three prototypes were developed, each based on the 
previous work In the method* 

For the checklist metnod, this project replicated part of 
the earlier researcn effort of Richards, Holland, and Lutz (1967)* 



*A review of the relevant literature is presented in Part TI of this 
report to familiarize the reader with the research which bears on the 
work of the project* 
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Their scales were otodifiedt sharpeaedt and leagcheaed for use ia 
particular fields* four checklists were developed to assess 
accomplishments in the biological and physical scieaces, 0 ^ 
social scieacest the humanitiest and writing* They included a 
number of strictly acadeotic as well as "nonacademic'^ attaiiunentSt 
with content appropriate for graduate education selection purposes* 

The work on the seati-^docuotented approach, based on the work 
of Schultz and Skager (1963) and Klein (1967) resulted in a survey 
vhich asKed general questions siodlar to those in the checklist 
approach but which asked for more information about accomplishments* 
Earlier surveys were adapted and expanded so that they could be 
used at the graduati^ level* Four forms^ paralleling tiiose of the 
checklist approach, were developed and represented an additional 
source of content for further development* 

The work of the CA£L project (Knapp, 19 75; Willinghamt et ol*, 
1976) was adapted Lo develop a modified structured open-*end<%d 
instrument designed to obtain the information that might be obtained 
Dy an evaluation of a portfolio of a student ""s earlier educational 
and experiental accomplishments* The format alljwed applicants to 
describe tneir previous activities in their own terms vithin set 
categories which directed their descriptions to shoC (l) the 
relevance of their experiences to graduate work in their field, and 
(2) the specific skills that were involved* 

Several basic questions were considered to determine which 
of the above approaches would be the best: 

(1) How open ended should the procedures be? 

(2) How should the quality o£ accomplishments be evaluated? 

(3) Uhat should be ttie nature of tUe content? 

(4) What is the best strategy for documentation? 

(5) What is the best mode of delivery? 

The work of Phase 2 described below, was designed to find 
answers to these questions* A third and fourth phase were planned 
as studies which would gather short** and long-range validity 
information on the assessments and would investigate the problems 
of putting the assessments into operational use* 

Worfe of Phase 2 

The prototypes developed in Phase I wc^re evaluated oy reviewers 
who were knowledgeable about: graduate education and test construction* 
The GRE staff at ETS also reviewed the forms for their implications 
for operations* These reviews and discussions led to many valuable 
suggestions for cnanges tr at would result in a form that could be 
used by the graduate community, could be operationally efficient, 
and which would have well worked out content and scope* As tnese 
reviews, revisions, and reconstructions progressed, it became 
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appareat chac three competing versions represented too much mater'.al 
for the reviewers to examine at the same time, and as they were 
revised, the instruments became much more similar, so that it seemed 
sensible to construct one instri^tment that would combine as many 
features of the three approaches as possible* Therefore, we analyzed 
our basic assumptions and materials were developed and organized 
which would outline alternative answers to the questions listed 
above* The arguments on eacH side of the questions were formulated, 
and analyzed for ttieir merits, and implications, as described 
below* The resulting prototype was based on the thinking shown 
in Table 1, which represent our best judgment of the most appropriate 
way to answer the first four questions above* The fifth question 
dealing with mode of delivery will be discussed later* 

Qg^nr:ended vs* objective format * We attempted to combine 
the advantages of the objective approach^'-^lmple and speedy adminis* 
tration, operational feasibility, clarity of responses^^'-with those 
of the open-*£cded approach**f lexibility and depth of information* 
In the working version of the questionnnaire , items ask applicants 
to indicate whether they had engaged in an activity, and, if they 
reply ''yes,*' to indicate when; the geographical distribution or 
level (local, city, state, national, etc*); whetner some public 
recognition of the accomplishment was provided (e*g*, publication, 
prize, award); and the number of similar accomplishments* Applicants 
also write out important details, such as name of publisher, 
contest, producer, etc* At the end of the questionnaire, applicants 
can choose three accomplishments they consider most relevant to 
their graduate educations and can outline the reasons they consider 
each to be important indicators of their readiness for graduate work 
in ttieir field* This format was designed to obtain the kind of 
comprehensive detail usually obtained oy open-ended questions, but 
using an objective format so that the applicant can move quickly 
through the survey* The operational use of the instrument would be 
greatly simplified by this format, since the main body of information 
about accomplishments could be processed by existing scoring ' '^ment 
and the pages of information about the most significant attai^-^^an^ 
could be processed and reproduced witnout undue bulK, mailing costs, 
or operational complexity* It also allows for the possibility of 
summarization and tne preparation of comparative information* 

Assessing the quality of attainments * Questions about assessing 
the quality of accomplishments needed to be considered, since they 
could affect the development of the prototype* These included the 
alternatives to scoring or summary that cocld d3 developed, who 
should do tne scoring or processing, whether a computer printout 
could be provided, the form of the report, whether a numerical sum 
of attainments in general areas of attainment could be constructed, 
and whetner standard weighting formulas or institutional or field 
specific wei^ntings would be needed* Furthermore, the handling of 
opeii-^endad responses will eventually need to oe addressed before an 
operational version is produced; e*g*, whether there should be any 
evaluation of opan^nded responses before they are sent to graduate 
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deparcmeacs, whether the applicaac or £TS sends cliem to deparcmencs, 
and how extensive the Incerprecive materials to departments would 
need to be* Some consideration needed to be given to these questions 
before tne prototype was developed* Therefore, the prototype was 
designed to be amenable to routine processing and summarization for 
most of the information while retaining a number of the features 
that vould recommend an unsummarized assessment of attainments, 
Including detailed information about the extent and level of achievement, 
the number of similar icnievements, and the significance of the 
attainment for graduate education in the applicant's field* 

The content * Discussions with representatives of various 
graduate disciplines suggested that the strategy of separate 
forms^for different areas— social sciences, arts and humanities, 
etc*~was not the best approach since many students nwe had 
vital educational accomplishments and experiences in areas far 
afield frcnn their major area of study* This fact argued for a 
single form that would ask applicants about a vide range of accomplish" 
ments in a wide variety of areas* Three other considerations 
reinforced this approach* First, the majority of students enrolling 
in graduate education today are in fields other than the traditional 
arts and science fields* Ihat Is, these fields do not really fall 
witnin tne traditional categories of graduate education such as 
physical science, Diologlcal science, etc* These fi^l<^^ generally 
also draw upon a wide range of backgrounds and tend to be more 
interdisciplinary* The second consideration Is that new and emerging 
fields also tend to be broad, interdisciplinary fields that draw on 
a wide range of talents* Finally, some proportion of applicants 
have had experiences or come from backgrounds that differ froa 
tnose of the traditional applicant* In order to fairly assess 
their experiences and accomplishments, it is necessary to assess 
a wide variety of acnievements* 

Documentation * The form needed to be amenable to documentation 
and verification whether this verification is conducted by £TS or 
tne graduate department and whether every accomplishment is checked 
or one o£ several other veriflcati'^n strategies Is used* Tnerefore 
the items In the questionnaire needed to ask for sufficient detail 
about eacn attainment so that documentation would be possible* 
However, it would be operationally difficult, as well as a burdensome 
task for tne applicant, to require extensive documentation for every 
accomplishment* Therefore, substantial confirming evidence was 
requested only for the accomplishments tne applicants considered 
most important* Thus, in summary, this prototype was designed to 
meet the operational and conceptual requirements of an inventory of 
documented accomplishments for graduate selection using as many of 
the positive features of earlier approaches in as simple a format as 
possible* Example items froia the survey accompany this report* 

This draft was sent to selected graduate deans, admissions 
officers, department heads, and faculty members in four institutions* 




-8- 



(Some students were asked to informally react to the survey earlier, 
and then opinions were reflected in the survey*) the staff and 
faculty members wkte asked to examine the questionnaire with 
five questions in aind: 

(a) How do you evaluate the effort and the approach we ^re 
using? 

(b) Are the kind of achievements assessed the really important 
ones; l*e*, are they things you would want to know about in 
your admissions decisions? 

(c) Would this format be useful to you, or would a more 
objective or open-tended fonaat provide more useful data? 

(d) Would you prefer to obtain the materials "unprocessed" 
or would you prefer socne summarization or evaluation 
of the accomplishments? 

(e) How much weight do you think you would place on such 
iaConaatiOQ If it were Included with application 
materials? 

In addition, they were asked to check any specific iteias 
in the survey that seem to tap especially important types of 
accomplishments y and circle any items they felt were o£ dubious 
value or were difficult to interpret* If they thought that some 
important accomplishments were not on the list, they were asked to 
write them down* 

£^ch institution was visited and the staff who were sent 
the questionnaire were interviewed using a semi*-structured 
interview guide concentrating on the above questions* These 
interviews revealed consensus on some of the issues we were 
interested in and disagreement on others, and raised some new 
concerns* Specifically, concerning the basic questions (numbered 
1 to 3 at the outset), their responses were as follows: 

1< How open ended should the procedure be? There was 
general agreement that the present prototype had about the right 
blend of open ended and objective questions* This confirmed the 
Judgment of the staff and the reviewers of earlier versions* 

2* How should the quality of achievements be evaluated? 
There was no general agreement on this question* Some felt that 
Summary scores should De provided for various areas of accomplishment, 
simply because of tne administrative and logistical problems of 
dealing with so much material. Others, who tended to be in small 
departments, ^VaiTd they would like to see the entire fona themselves- 
One option ^^hich appealed to many would be to simply record the item 
number and list an abstract of each accomplishment checked, and to 
reproduce the last three pages that explain the Importance of the 
tnree oest attainments* However, this question does not need to be 
answered immediately, but can be investigated by the research of the 
next phase of the project* 
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6* tiow can the procedures avoid bias against students froci 
minority and low income families? Several ot the interviewees 
raised this question, but had ideas about appropriate solutions* 
Fortunately, it was possible to ask tor the reeomioendations of the 
GREfi Idinority Graduate Education Committee at their December 1977 
meeting, for improvements in language usage, examples, phrasing, and 
accomplishments* Their suggestions were incorporated into 
the instrument* 

7* How can the accomplishments of applicants from colleges 
of different sizes and selectivity be fairly compared? Several 
interviewees pointed out that it is much easier to engage in some 
of the activities included in the accomplishment survey in small 
or unselective colleges* Thus, an accomplishment in a very large 
or very selective institution probably represents a higher level 
of attainment than the same accomplishment in small or unselective 
colleges* One possible solution would be to provide normative 
or comparative InformaLion for colleges of varying size and selectivity 
(or, at least, indicate colleff,e size)* 

The version of the inventory that is being tried out in Phase 3 
of this project represents our best effort to find balanced answers to 
these questions* The instrument is reproduced as part III of this report* 

Tmplications for Phase 3 

Several questions and possible options emerged from these 
interviews which have considerable Implications for the next 
phase of the project* 

Documentation * What are the implications of the apparent 
lack of concern aoout documentation? Should we simply provide 
the service with no attempts to document the validity of applicants^ 
statements, or continue our attempts to develop some form of 
operationally feasible documentation? (The latter could include 
something as simple as flagging statistically rare responses, and 
retaining a copy of the open ended questions at the end* This 
option has been recommended by the GR£ staff concerned with operational 
issues*) The problem of memory decay—^the tendency for applicants 
to forget details of their accomplishment — also needs to be addressed* 
The next phase of the project will attempt to answer r.hese questions, 
particularly in terms of the materials themselves* An effort will 
be made to design the inventory, instructions, and procedures in 
such a way as to promote accurate and fair reporting and their 
documentation* 

Evaluation * tiow should the r'^sponses to the survey be summarized 
and processed? Some possibilities that were suggested by the GRE 
staff, along with some related questions or arguments were as 
follows: 

Does any scoring occur? If so, 

A* Who does the scoring? 
1* Scoring by ETS 
2* Scoring by each graduate 
Q department \ 
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Bt Scoring of checklist items 
1* Computer printout of the 

text of each item checked, 

plus the magnitude or 

level of the accomplishment 
2, Numerical sum (simple Subscores might be provided 

total) with option of for number of items checked 

subscores for each area within a certain field (e*g*t 

science), by the ^'magnitude*' 
of the achievemet.*:, etc* 
As indicators of magnitude 
or level t the survey uses 
numbers of similar attainmentSt 
how widely circulated, what 
prize wOQt size of audience, 
size of geographic area, and 
college vs* post^college* 

3* Numerical weighting 

a* Standard weighting formulas 

for everyone 
b* Institutionally specific or 

department ally specific 

weighting formulas 

Although tnese questions are quite detaxledt the answers 
to them tiave strong implications for the cost and emphasis of the 
next phase of this project and the eventual operational use of 
tne survey* 

Clearly, there may be some degree of ^'scoring** in the next 
phase because of the analyses that will be conducted to refine the 
instrument and assess its soundness (e*g* » to identify groups of 
items; to eliminate items; and to clearly distinguish outstanding 
from routine accomplishments)* Kowevert it is doubtful that such 
scoring and analyses would be the same for operational use of the 
instrument* It is more likely that the exploration of different 
metnods of summarizing, reporting, and weighting, and evaluating 
student responses in tne next phase will lead to operational analyses, 
summatias, and reporting formats that are quite different frotn the 
item analyses needed for research purposes* 

Subgroups ^ The next phase will deliberately seek out and 
sample departments that attract applicants from colleges o£ different 
sizes and selectivity and from minority groups* 

Students and faculty reactions ^ The reactions of graduate 
school faculty and staff in this stage suggested that they are 
generally in favor of the idea behind the instrument, bu that 
they were less certain about how they might use it in practice* 
Therefore, the next phase will actively seek out the advice and 
reactions of department and graduate school staff in the sample 
who are concerned with admissions* Participating departments will 
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be interviewed to determine: (1) whether their faculty feel the 
inventory contains items that are relevant to professional 
accomplishments among their students and graduates; (2) the useful^ 
ness of the information provided to them; (3) their strategies 
for its use; and any problems they may have had* 

Sifiiilarly, a sample of students will be interviewed to obtain 
their reactions to the inventory* Students will be queried about 
the length of the instrument, clarity of items, ease of adrainistra^ 
tlon, suggestions as to additional items, accomplishments left out, 
and their perceptions as to the susceptibility of their self*-reports 
to forgetting. 

Summary evaluation of materials * The responses of students 
to the questionnaire about their experiences in completing the 
instrument and the responses of department admission committee 
members in the interviews on their use of the instrument will be 
tabulated, and their coimnents summarized* The reports of students 
of problems they i:/\ced in completing the assessment and departments 
in using the information will be actively sought, so that the opera^ 
tional feasibility can be estimated and eventually improved* An 
attempt will be made to answer questions about the normative informa- 
tion possible and necessary, representativeness of the samples used 
in the development, presentation of validity information, and 
problems of possible spurious effects of social desirability* The 
eventual instruments should be simple, reliable, comprehensive, and 
valid* During Stages Three and Four, close consultation with GRE 
program staff and ETS technical experts will be crucial in developing 
the format and details which would permit the instruments to be 
included as a service of the GRE program* 
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Parc II 

llie Prediction of High Level AccomplishmenC : A Review 
of Selected Literature 



Leonard L* Balrd 



Purpose 

The purpose of this paper is to review the research base 
for the development of an inventory of accomplishments suitable 
for use in the graduate school admissions Process* The review 
is basically provided as background for the discussion of this 
development in the main body of this report* 

J 

Introduction 

People have been concerned with tha prediction of high 
level accomplishment for many years* Thousands of years ago, 
the Chinese developed the Imperial examination system in an 
effort to find people who would be outstanding officials and 
ministers of the state* More recently, researchers have under*** 
taken a wide variety of studies to determine the antecedents of 
high level accomplishment in science, writing, creative arts, 
and leadership* This review summarizes some of this research, 
and shows that there is evidence that high level accomplishment 
can be predicted with some success, even if we do not have a 
complete understanding of the process of achievement* Much of 
this research has been conducted in samples of college students 
or industrial researchers* 

Consequently, since our major Interest is in what research 
suggests might be done in graduate school adiiissions, our argument 
will have to be somewhat indirect* However, many of the questions 
which apply to graduate school admissions have been addressed in 
research in other areas, so their results are more relevant than it 
might first appear* Let us define the area that will be reviftwud* 

This paper will concentrate on biographical and other simple 
predictors of high l^el performance* Studies of the creative 
process (Golann, 1963) or of the personality of persons who 
achieve at high levels (recently reviewed by Delias and Gaier, 
1970) are, of course, very valuable in our search for the bases 
of high level accomplishment, but this paper concentrates on 
biographical information about previous activities and accomplish* 
ments* Without attempting to citr* all the comparative success 
of studies using different classes of variables to predict high 
level accomplishment, we will simply assert that, from the current 
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evidence, the conclusion of Taylor and Holland (1964) scill 

stands: biographical information about earlier activities 

and accomplishments is consistently the best predictor of 

high level performance. Further, information about the biographical 

precursors and the development of accomplishment could lead do 

changes in personal, educational, or organizational practices that 

would foster greater accomplishment* 

This review will also concentrate on studies of real-life 
criteria of accomplishment, following the guidelines of MacKinnon 
(1962). These include: (l) originality, uniqueness, or statistical 
rarity; (2) adaptation to reality, aiding in the achievement of 
some real-'life goal, such as a scientific or aesthetic problem; and 
(3) sustained activity leading to the development, evaluation, and 
elaboration of an original idea* Studies bas^d on such criteria 
as having a "creative*' profile on a personality uest, or other 
arbitrary classifications devised by a researcher will receive 
less attention* 

Biographical inventories of earlier activity and accomplish** 
ment have been related to high level accomplishment in several 
populations: college students, high school students, scientists, 
and professionals in academic and professional practice* These 
studies will be reviewed in following sections* 

They are presented here as evidence for the power of measures 
of accomplishment at one level to predict accomplishment at 
another* Their relevance to the graduate school will be discussed 
in the final section* 

College students * High level accomplishrsnt among students 
has been examined in many studies* As a natural outgrowth of 
their concern for talent. National Merit Scholarship Corporation 
reported a series of studies concerned with high level accomplish- 
ment. These studies include many significant relations between 
biographical information and achievement in college* "Achievement" 
consisted of such accomplishments as "Had a scientific or scholarly 
paper published (or in press) in a scientific or professional 
journal," '^Received an award for acting, playwriting or other phase 
of drama," "Was editor or feature writer for collegiate paper, 
annual, magazine, or anthology, etc*," "Composed music which has 
been given at least one public performance," "Won a prize or award 
in an art competition, painting, sculpture, ceramics, etc*" 
"Organized a college political group or campaign*'* Scales were 
developed for six areas: science, art, music, leadership, drama, 
and writing* In studies by Holland and Nichols (1964), and 
Nichols and Holland (1963), nearly every major test that has been 
suggested for the prediction of accomplishment was used in the 
predictor battery, including personality scales of all sorts, 
interest measures, assessfi^ents of cognitive styles, "creativity 
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tests," and high level ability tests* The best predictor of 
accomplishment in college was accomplishment in the same area 
in high school, as measured by simple check lists of nonacademic 
achievements* (Similar results have been found in a large 
sample study of more typical students {Baird, 1969]*) Other 
National Merit studies by Roberts (1965) and Nichols (1966) 
studied the itea correlates of high level accomplishment* Roberts 
developed scales for six areas of accomplishment: science, arti 
writing, music, leadership, and speech (as defined by the same 
sort of items described earlier)* In general, more achievers in 
each area endorsed the items expressing interest, activity, or 
competence in each area than did the nonachievers* These items 
tended to be directly related to the kinds of accomplishments 
later exhibited in college* As Roberts states: "Many of the 
items in each scale were directly content^related to the area of 
criterion achievement* and a fair number were related to other 
specific areas of activity and achievement*'* For example, in 
the science scale, more than half of the positive predictors were 
"direct indicators of scientific activity or interest and several 
others may be "technological** in nature (e*g*, photography, nature 
collections)/* Nichols' correlations also indicated that previous 
behaviors were g£:nerally the best predictors of high level accomplish* 
ment in both a Merit sample and a sample representing a broad range 
of talent* (Biographical information about previous accomplishments 
was a better predictor than the personality, interest, or ability 
scales that Nichols also used in his study*) Other studies using 
large samples of average students have shown that scales measuring 
high school nonacademic accomplishment are the best predictors 
of later accomplishment in college and have sufficiently high 
correlations to be of practical use (Richards, Holland, and Lutz, 
1967; Baird, 1969)* Ability, personality, and interest measures 
were generally poor predictors in these studies* 

The need for measures of out of class accomplishment in addi- 
tion to measures of academic accomplishment is evidenced by the 
fact that, in all these studies, there was little relation between 
grades, acad^ic ability as measured by test scores, and later 
accomplishment* The need is further emphasized by the work of 
Wallach and Wing (1969) who replicated these studies in their 
study of Duke University students in which little relationship 
between academic and nonacademic achievement was found using methods 
other than correlations* Baird (1968) similarly compared bright 
and average students and found little average difference in their 
nonacademic accomplishments* Elton and Shevel (1969) further 
clarified the issue by examining individual items on the American 
College Testing Programs* scales of accomplishment and finding 
that some out-of-class accomplishments were related to measures 
of academic talent but about an equal number showed a negative or 
no relationship* 




High school students * The studies of high school students 
provide somenltat Indirect evidence of the power of measures of 
previous accomplishment to predict later accomplishment* They 
are reviewed here because of they show that previous activity and 
experiences which are related to accomplishment are predictive 
of later accomplishment, as well as earlier accomplishment, per se* 
Long term activity and Interest In an area may not result In 
publlcally recognizable accomplishments; but they do show that 
behaviors consistent with later accomplishment are Important; 
accomplishment does not appear overnight* Taylor, Cooley, and 
Nleldon (1963) applied a blographL^al questionnaire developed on 
NASA scientists and which concentrated on previous activity and 
accomplishments, to high school students participating In a 
National Science Foundation summer program* Using ratings of the 
creativity of the students' research performance as the criteria, 
the blot^raphlcal questionnaire proved to be the best overall 
predictor* 

Schaefer and Anastasl (1968), and Anastasl and Schaefer (1969), 
developed biographical Inventory keys against criteria of creative 
accomplishment among high school boys and girls* Separate keys 
were developed for (a) science and (b) art and creative writing, 
and cross validated In second criterion groups* Cross-validated 
validity coefficients among the boys were *35 and *64 for the 
science anc* art-wrltlng scales, respectively. For girls, art and 
writing were predicted In a cross validation with correlations 
of *34 and *55, respectively* Using a similar biographical Inven- 
tory and the same sample, Schaeffer (1969) was able to predict 
creative performance In art for boys (*65), writing for girls (*55), 
and. In combination with personality scales, science for boys (*48) 
and art for girls (v55)* In their dlscuf^sion of the contents of 
these scales, Anastasl and Schaeffer (1969) pointed to the common 
characteristics of high performing adolescents (with some support 
from other studies)* These were: continuity and pervasiveness of 
Interest In the students' chosen field; prevalence of unusual, novel, 
and diverse experiences; and the educational super^ rlty of the 
students' family background* The first point deserves some reem^ 
phasls* Two other studies (Balrd, 1968, 1969b) Indicate that 
accomplishment often begins In adolescence or before In exploratory 
activity, often resulting In recognized achievement* Balrd and 
Richards (1968) and Balrd (l969b) found that such accomplishment 
seldom begins In college; there are few **late bloomers**' The 
great majority of students who show accomplishments In college 
showed similar activities In high school* Anastasl and Schaeffer 
(1969) point out: 

Typically, the highly creative adolescent girl 
In this study bad manifested an absorbing Interest 
In her field since childhood and her creative activi- 
ties had received recognition through exhibitions. 
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publicatioTit prizes, or awards* Her initial interest 
Was thus reinforced and reinforced early in life by 
persons in authority, such as parents and elementary 
schoolteachers* The continuity of creative achieve- 
ment over time is corroborated by the findings of other 

investigations, notablv Helson's (1965* 1967) research 
with college women, the surveys of National Merit 
Scholarship finalists (Holland & Astin, 1963; Hichols 
& Holland, 1964), and our own earlier study of crea^ 
tive high school boys (Schaeffer & Anastasi, 1968)* 

Similar results are reported in studies of industrial scientific 
and professional samples, reviewed in the following section* 

Predicting high level accomplishment ainong scientists and 
other adult groups from biographical records of accomplishment and 
activity^ Biographical variables dealing with both past accomplish- 
ments and past activity and interest similar to those just described 
have been found to characterize scientists who have demonstrated 
a high level of accomplishmem:* For example. Roe (1952) found 
many unusual biographical chax'^cteristics of scientists in her 
sample* Kulberg and Owens {I960) and Morrisson, Owens, Glennon, 
and Albright (1962) found that biographical information correlated 
with the creativity, professional interest, and research competence 
of engineers and scientists* Albright and Glennon (1961) found 
that biographical variables distinguished between supervisory and 
research oriented scientists at all levels of a laboratory organiza- 
tion* Smith, Albright, and Glennon (1961) also found that biographical 
information predicted rated scientific competence, rated creativity 
and number of patents within a group of research scientists* These 
three criteria were predicted in a cross-validation sample with 
correlations of *61, *52# and *52# respectively* The content of the 
items suggests high self-confidence and high self-conception* ^This 
interpretation is reinforced by the frequency with which the high 
criterion groups say that they (a) have more readily taken advantage 
of opportunities presented them» (b) consider their achievements 
thus far to be greater than those of others with the same education, 
(c) work more quickly than others, and (d) prefer to have many 
things 'on the fire^ simultaneously*'^ It might be noted that these 
descriptions are based primarily on answers to factual questions 
about the scientists^ accomplishments* Chambers (1964) used both 
biographical and personality test variables to study creativity in 
chemists and psychologists* Three personality scales and 16 bio-* 
graphical items were significantly related to the criterion of 
creativity* The more creative scientists more often had fathers 
who were professional men, graduated from high school earlier, 
spent more hours per week (more than 50) in study and research in 
graduate school, published more articles then, and more often met 
their graduate school escpenses by scholarships and fellowships 
than by part-time work* 
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HcDermid (1965) found chac biographical va: ables were the 
best predictors of supervisory and peer racings of high level 
(in this case, creative) performance* HcDermid also used personality 
tests (the California Psychological Inventory and the Adjective 
Check List) an interest test (The Vocational Preference Inventory) 
a high level intelligence test (Concept Mastery Test), the Social 
Insight Test and Welsh Figure Preference Test* All these tests had 
been used in other studies of creativity, but were not useful in 
HcDermid's sample of engineering personnel* HcDermid concludes 
"The correlations obtained in this study between paper and pencil 
tests and the criteria of creativity were so low as to be virtually 
useless for predictive purposes; biographical data, on the other 
hand, proved to be significant as predictors of both supervisory and 
peer ratings of creativity* This finding, of course, is quite 
consistent with the practical dictum that the best predictor of 
future performance is past performance* * *" 

Taylor and Ellison (1967) summarized eight years of work on 
the identification of biographical predictors of scientific perfor* 
mance* In the last NASA scientist samples the cross-validated 
correlations with ratings of creativity were *4l, with the number 
of publications *62, and with GS level, *72* The factors in the 
Taylor and Ellison stuciy were consistent both with other studies 
of accomplishment in science and the studies of students just 
summarized* The highly performing scientists, as the students, 
tended to have a conception of themselves as capable of high level 
professional performance,, be independent of others' opinions, 
have great dedication to their work, work very hard, have clear 
ideas of their goals, which they set at a high level, and be 
intellectually oriented, a trait that developed early in adolescence* 

Finally, Hunday and Davis (1974) have shown that biographical 
accomplishment scales administered in high school predicted adult 
accomplishment six years later* The adult accomplishments included 
such things as *'was author or coauthor of scholarly or scientific 
article accepted for publication in a popular or professional 
journal or presented as a public lecture,** **received an award for 
acting or some other phase of drama,'* **sold one or more works of 
art to collectors, museums, or the general public,** **won a literary 
award or prize for creative writing,** **composed or arranged music 
which was publicly performed,*' and "been a candidate for election 
to school board, city, county, or state office*** 

The median correlation between the high school accomplishment 
scales and the corresponding adult scales was *25 for men and *26 
for women when graduates and nongraduates were combined* In con-* 
trast, the median correlation between high school grades and adult 
accomplishments was *03 for men and *00 for women, and the median 
correlation betwe^ ACT composite scores and adult accomplishments 
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was .06 for men and *10 for women* The median correlation between 
college grades and adult accomplishments was *09 for all students 
combined* This study is important because it shows the long range 
validity of the biographical accomplishment scales, even after the 
intervention of college and work, ^nd illustrate again their 
superiority over other measures* 

In sum, the studies reviewed here support the conclusions 
reached by Baird (1969a): 

There is some consensus, then, that students who 
later achl^va * * * (in creative activity, as well as 
academic activity) have engaged in activities and 
developed skills related to that area, have conscious 
goals and desires to achieve in that area, and 
describe themselves as having ability in that area» 

* * * The achiever » » * has a history of activi- 
ties and achievements related ^ to his present achieve- 
ment* He is motivated to achieve in this area and 
accurately assesses his own talents* Perhaps rather 
than attempting to develop new scales to describe 
some universal creative mind, psychologists should 
concentrate on the development of more accurate and 
reliable measures of past activities, goals, and 
self -description* 

These results and those of the student samples suggest 
that measures of accomplishment could be used for the early 
identification of students with the potential for high level 
accomplishment, and as one of the bases for selecting stu* 
dents for special programs* In most of these studies, 
biographical Information about past accomplishment was the 
best predictor of later performance, better than ability, 
interest or personality tests, suggesting the power of 
these variables for particular purposes* 



We have just seen thfs power of biographical accomplishment 
information to predict subs<±quent high level accomplishment* The 
studies just reviewed indicate that this information is considerably 
more useful than most other kinds of information* However, before 
we consider using this kind of data in practice we need to answer 
four questions about itt (1) can we believe students' reports?, 
(2) can measures be constructed which meet standard psychometric 
criteria, (3) how would such measures be used in real^life 
selection situations, and (4) are such measures fair to students 
from disadvantaged backgrounds? 



Some Questions About Direct Assessment of 
Biographical Accomplishment Scales 
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The Validity of Direct Measurement per se 

Probably the most critical issue In the use of reports of 
accomplishments is whether ve can believe a person's responses* 
There Is some evidence that these r^orts can be believed* However, 
It may be useful first consider the general question as to whether 
one can believe what people say on questionnaires » since this 
bears on the general validity of questionnaires concerning accom- 
plishments* The problem Is, slmplyt beyond obvious and Innocuous 
Information such as his vocational choice or hometown size, can 
or will persons give accurate accounts of their history and present 
status? The few studies of the validity of self-report provide 
a fairly consistent answer to this Question* As early as 1937, 
Walker found that college students' reports of factual Information 
such as their father's occupation and class standing agreed very 
well with official records* Harris (1946) found high validity for 
a questionnaire he used In a psychiatric setting* Hosel and Coyan 
(1952) reported high validity for application blank work histories 
In Industrial settings* They found a high level of agreement 
between the claims niade by job applicants and the reports of past 
employers with respect to weekly wages, duration of employment 
and job duties* All correlations except one were *90 or greater* 
Hardin and Hershey (1960) found that when workers* reports of their 
wages on a questionnaire were checked against company pay records, 
the worker and company figures correlated *98 among women, and *99 
among men* About eight percent of the sample under- or over-stated 
their pay by plus or minus six percent. Interestingly, about three 
times as many employees understated their pay as overstated It* 
Clausen (1968) compared self-reports of voting In elections to 
official records and found an "invalidity** rate of approximately 
6*9 percent* He cautions that this may be an overestimate, for 
''All errors that lead the Investigator astray In, tracking down the 
record of the respondent's vote, e*g*. Incorrectly spelled name. 
Incorrect address, have the one sided effect of challenging the 
validity of the respondent's vote report*'* This Is a very important 
point to remember In every study of the validity of self-reports* 
One should not simply assume 100 percent accuracy In official 
records and the reports on those records* 

Calahan (1968) asked a number of Denver adults questions 
ranging from whether they had a phone in their homes to whether 
they contributed to the Community Chest* The self-reports on many 
factual questions were quite accurate* After a variety of analyses, 
Calahan noted that accuracy was higher for Items concerned with 
recent facts* Calahan concluded that respondents generally will 
give accurate responses even when it may reflect on their prestige, 
provided that the question of fact concerns the respondent's 
recent activities rather than past events* 
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In samples of college students, Walsh (1967, 1968, and 1969) 
has found that students generally provide accurate reports of 
their past behavior, even when items deal with sensitive issues 
such as failing courses* However, Calahan^s comments seem to 
apply to college students, as well* Thus, Walshes students 
seemed to have a little difficulty recalling remote or insig- 
nificant events, but, "* * * if an error of plus or minus *20 was 
permitted in a students report of his previous semester CPA, then 
the percentage of accuracy would be 100 percent/' Overall » Walsh 
found a very high level of accuracy* In addition, Walsh did not 
find any difference in accuracy between interview, questionnaire 
or ''personal data blank*'* In his later studies, Walsh found that 
the level of accuracy of self-report was not changed when students 
were given financial or social incentives to distort their self- 
report* Studies of the validity of self-reported grades reviewed by 
Baird (1976) also generally indicate that students provide quite 
accurate information about themselves* 

Let us now turn directly to measures of accomplishment* As 
part of a comprehensive study of tha accuracy of self-reports on 
a questionnaire administered with a national college testing program, 
Maxey and Ormsby (1971) studied the agreement between student^ 
reported and school-reported nonacademic achievement on 28 items* 
(They also studied the accuracy of self-reported grades, and reached 
the same conclusions as did Baird, 19 76, that students usually give 
very accurate reports of their grades*) Their sample included 
5775 students completing the ACT battery* Their reports were 
checked with school reports in 134 high schools* The achievements 
were in athletics, leadership, music, speech, drama, art, writing, 
and science, and included such items as "Edited a school paper or 
yearbook" and "Placed first, second, or third in a regional or 
state science contest**' The average level of agreement between 
student report and school records was about 90 percent* But this 
did not mean thal^ 10 percent of the students were exaggerating* 
On the typical item only about 6 percent of the students claimed an 
accomplishment for which the school had no record* For the other 
four percent of students, the school credited th^ with an achieve- 
ment they did not claim* The items on which there was greatest 
agreement tended to be highly visible, easily verifiable items such 
as ''Placed first, second, or third in a regional or state speech 
contest*" Conversely, the items on which there was less agreement 
tended to be behaviors about which the school would have little 
information, such as "Actively campaigned to elect another student*" 
No systematic differences in agreement were found when the data 
was broken down by sex or family income level* Students who made 
better grades tended to be slightly less accurate than those who made 
lower grades* The authors think this may be due to a tendency 
for students with higher grades to be more active in school social 
activities in ways unknown to school personnel* The fact that the 
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students^ reports of achievement were gathered while they were com** 
pleting a national assessment for college admission leads one to 
expect them to be exaggerated* The fact that they tended not to be 
adds strong support to the idea that sel£*reports are accurate* 

A great deal of other evidence on the validity and utility of 
self-report measures is reported in Baird (1976)* 

In summary* from the evidence available* it appears that ques** 
tionnaire responses have useful validity* More particularly the 
validity of questions about past accomplishments appears useful 
enough for the decisions and actions that they could be used for* 

Can biographical measures of accomplishment be made psycho- 
metrically adequate ? The studies of the scales developed by the 
National Merit Scholarship Program (Nichols and Holland* 1964), 
the research on more average college students (Richards, Holland, 
and Lutz, 1967; Richards and Lutz, 1968) and the operational work 
of the American College Testing Program (ACT Technical Report, 1973) 
show that biographical accomplishment scales can be constructed 
with adequate reliability* Occasional skewness in the scales does 
not present a serious limitation (Holland and Richards, 1967)* 
The validity of the scales does not seem to be affected by restric- 
tions of range on academic talent (Holland and Richards, 1967; 
Baird, 1969a)* The validity of the scales, discussed earlier in 
the review also indicates the psychometric adequacy of the scales* 
All of the results may be underestimates because of the brevity 
of the scales used in these studies* In sum, it appears that 
biographical accomplishment scales can be constructed which meet 
standard psychometric requirements* 

Can biographical accomplishment scales be used in practice ? 
Biographical accomplishment measures have seldom been used in real* 
life studies of the selection of college or graduate students so 
there are few guidelines for the person who would like to make use 
of these variables. A few industrial studies provide some stimulating 
suggestions, but these are few and far between* Certainly, very 
few, if any, colleges or graduate institutions have made paat extra- 
academic accomplishment the most important basis of their selection 
procedures* However, a study by Baird and Richards (1968) simulates 
what would happen if various selection procedures were followed for 
admission to college and this study suggests some of the practical 
problems using accomplishment data in selection decisions. The 
authors compared the results if: 1) only academic criteria were 
used to admit students to college; 2) only criteria based on 
previous creative accomplishment in each of six areas were used; 
and 3) both acactemic and creative accomplishment were used* A close 
examination of the study leads one to the conclusion that an educa* 
tional institution cannot have everything* For example, if an 
institution selected students only for high level accomplishment 
rather than for grades, it would increase its dropout rate* However, 
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an institution could still make use of nonacademic predictors of 
creative accomplishment* For example, as Baird and Richards 
suggest, * * a college could decide which areas of achievement 
it wished to emphasize; that is, whether it preferred more or 
fewer students with potentials for achievement in leadership or 
science, art or writing, speech and dratna or music*" 

A college or graduate school's choice of a particular selec- 
tion strategy is a function of the outcomes it values most* 
Institutions must choose the relative value of obtaining (a) a 
group of students who vill attain high grades (b) a group of students 
who will achieve in the accomplishment areas it is interested in 
(c) a group of students who will not drop out, or (d) some other 
group of students which it values* Although an institution can o'btain 
a student body which will show various proportions of these outcomes, 
it would be hard pressed to find an incoming group of students which 
is desirable in every way* On the other hand, a college or graduate 
school can obtain a group of students who will fit its purposes 
and goals to a reasonable extent* 

Are the measures fair to disadvantaged students ? One fundamental 
concern about these measures is whether they are fair to students who 
Dtay not have had opportunities for accomplishment* If they have not 
had a chance to engage in various activities, or attended institutions 
lacking in appropriate facilities, they would be expected to appear 
lacking in accomplishments* TJie evidence on this point indicates 
that students from disadvantaged backgrounds do about as well on 
assessments of their real-life accomplishments as do other students* 
For example, Baird (1967) compared students from families with 
different incomes in a national sample of 18,378 college bound stu- 
dents* The groups ranged from "below $5,000" (approximately the 
lowest quarter of incomes in the national distribution at the time of 
the study) to "25,000 and above" (approximately the top one or 
two percent)* The differences between the groups were very small 
and, in the case of higher levels of achievement, virtually non- 
existent* In a second study, Baird (1969) studied the relationship 
between family income and educational ambitions in a national random 
sample of 15,535 college bound students* Although educatic^ial 
aml)itions were significantly related to accomplishments in several 
areas, family income was not* That is, students from families with 
different incomes did not significantly differ in the number or 
level of accomplishments they reported* (It is thought provoking 
that both studies showed significant differences among the income 
erouDs on measures of academic ability*) This lack of relation between 
accomplishments and fc^utily background is supported by the National 
Merit studies which reported no significant correlations between 
these two types of variables in their samples* These results 
suggest that the accomplishment measures do not discriminate 
against disadvantaged students, although <!is advantaged students 
do score lower on academic ability testsr 
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Studies of the large sainples of college freshmen obtained 
by the American Council on Education also show that Black students 
report ju^t as many accomplishments of the kind we have been 
discussing as do White students* Bayer and Boruch (1969) compared 
the high school accomplishments o€ 12,300 Black college freshmen 
with those of 230,582 non-Black students enrolled in 358 colleges, 
and found no differences* Bayer (1972) found the same results when 
he compared the accomplishments of 12,927 Blacks with 158,1X1 non- 
Blacks in 324 colleges* These results held in all types of institu^ 
tions* In short, the evidence indicates that reports of accomplish^ 
ments do not discriminate against disadvantaged or minority students* 
In fact, since these studies were based on reports of high school 
accomplishments, where one would expect any discriminatory effects 
to be much larger than in college, it seems logical to believe 
that there would be little, if any, difference among the attainments 
fo graduate school applicants* (In fact, in the national sample 
of low and other income students studied by Holmstrom [1973], there 
were no differences in the handful of college achievements she 
studies* ) 

Implications for a Graduate Admissions Inventory of Accomplishment 

The implications can be stated fkirly briefly* (l) Since the 
consensus of the studies indicates that information about past 
accomplishments is the best predictor of later accomplishments, 
graduate school admissions^ committees who wish to select students 
with the greatest potential for future accomplishment should look 
for evidence of students^ past accomplishments* (2) Satisfactory 
measures of past accomplishments have been constructed at other 
levels, so it seems plausible to believe that such measures can be 
constructed at the graduate school admissions level* (3) the 
measures that have been constructed appear to have adequate reli^ 
ability, accuracy, and validity, so it seems plausible to think 
that measures which are adquate in these ways can be developed for 
graduate school admissions* (4) The measures seem independent of 
academic aptitude, so similar measures for graduate school admissions 
would probably add a good deal o£ information of a new kind to the 
admissions situation, and (5) studies simulating the use of these 
measures show that different selection strategies produce different 
results, so graduate schools should not see these measures as 
panaceas, but as a new kind of information* 

Summary 

Biographical accomplishment infon/tation provided 
u..eful prediction of later high level accomplishment in a wide 
variety of samples and settings* In these studies, no other class 
of variables proved nearly so useful* The information seems believ- 
able, it can be psychometrically adequate, and it can be used in 
various selection strategies 4 A strong case can be made for the 
utility and value of biographical accomplishment information* 
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BACKGROUND QUESTIONS 



The following questions will be used for research purposes only* Your responses 
will be used to help us identify items that might be unfair to various groups of 
students and to help us understand the results of the study* They will not be 
used in any other way, will not be communicated to your department or university, 
and will not be seen by anyone except the research staff* We encourage yoti to 
answer all the questions so that the results of the study will be more accurate* 



1, In what year did you receive your 
bachelor's degree? 



2. 



3. 



What was the full name and 
location of the college that 
ai>rarded your bachelor's degree?, 

N<ime 



Location 



Was your undergraduate major in 
the same field you are now 
studying as a graduate student? 



5* Considering only your last 
two undergraduate years, 
approximately what overall 
grade average did you receive? 
(If your college does not use 
letter grades* please mark the 
letter grade that is the 
closest equivalent to your 
grade average*) 



o 
o 
o 
o 
o 
o 
o 



D or lower 

C" 

C 

B- 
B 

A- 
A 



Yes 



No 



6^ Have you attended another graduate 
institution on at least a half- 
time basis? 



4* What was your undergraduate major? 



c> No 

^ Yes, for less than a year 

^ Yes, for a year or more 

^ Yes, and I obtained a Master's 
degree 
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7. What is your eventual graduate degree 

objective In your current field? 

o Noil degree study 

o Master's M.S., M*Ed*, etc.) 

o Intermediate (such as Specialist) 

o Doctorate (Ph.D,, Ed.D,, etc.) 

o Postdoctoral study 

8, What kind of position do you hope to 
hold on completion of graduate 
school? Xf you are considering more 
than one, mark one first preference. 

o Postdoctoral fellowship 

o Teaching or administration in 
elementary or secondary school 

o Teaching in junior college 

o Teaching in a four-year college 
or university 

^ University research and teaching 

o College or university administration 

^ Research In industry or with non- 
profit organization or institute 

o Self-employed professional practice 

^ Professional practice with a clinic, 
hospital, or agency 

^ Executive position (ndmlnistrator, 
curator, etc.) in a nonacademic 
organization including government 

o Other (Specify): 



9. On the average, how many hours a week 
did you work during your last two 
yearf; of undergraduate college? 

Did not work 

I- 10 hours 

II- 20 hour& 

^ 21 or more hourt; 



10. Did you work between the time you 
graduated from college and the 
time you entered graduate school? 

o No 

o Yes, but only part*-time for 
less than six months 

o Yes, part-time up to a year 

o Yes, full-time for less 
than six months 

^ Yes, full-time up to a year 

^ Yes, full- or part-time for 
more than a year 

11* Wliat is your sex? 

^^ale 

^ Female 
12. What is your age? 



13* Are you a United States citizen? 

o Yes 
o No 

14. How do you describe yourself? 

^ American Indian or 
Native American 

^ Black, Afro-American or Negro 

^ Mexican- American or Chicano 

^ Oriental or Asian-American 

^ Puerto Rlcan or Spanjsh-speakii*^ 
American 

^ Wliite or Caucasian 

^ Other 
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Iho questions in this section refer to wriLuig and publisLing activities. Answer each 
question by BLACKENING tlHi APPROJ*RIATli CIRCLE .ifCer each question. 

If you indicate belou that you have engaged in a listed activity, please provide all 
the information about th^^ activity as requested by the columns. If you indicate 



In college or prior to applying 
to graduate school, did you: 



2- 
3, 

5, 
6. 



8, 
9 



10, 

11 

12, 
13, 



Write ci short stor y , 
Write a poem. 
Write a play. 

Write a "literary" article or essay. 

Write a scientific article, 

Write a ''genernl" article, Cc-g*, 
newspcipor report , ed itor ial , p^nnt>h let ) ♦ 

Write a book dociling with some aspect 
of the sciences or social scionces. 

Write a "literary" book, (e.g., novel, 
book dealiitg with social issues), 

Author or coauthor an article 
presented at a professional meeting 
or conference. 

(Fill in the n.im' of the profossional 
;i3;sociat ion on tho Hnp at the right*) 

Cotnpose a symphony, concerto, or 
±;onat a ^ 

Comi>osc a "popular" cong or "show" tuno 
Draw cortoons or illustrations- 
Ohtain a patent or patent discLosnre. 



14- Take photographj; for a npvj*;pnpcr or 
inaga^^ine . 



15. Work as eflitor ol n ptibl icar t on , 



Have you 
engaged in this 
activity? If 
you mark "Yes 
fill in the 
rows at right 
No Yes 



o 
o 
o 
o 
o 



o 
o 
o 
o 



o 
o 



o 
o 
o 



o 
o 
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Wlien? 



00 Of 

Of 00 

rH Of 

fH rH 

O fH 

O O 
O 

00 

c u 

^ u 

O < 



O O 

O O 

O O 

o o 

o o 



o o 

o o 

o o 

o o 

o o 

o o 
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that you did not engage in the activity by marking "No," go on to the 
next question. 

you engaged in a listed activity more than once, describe the one that you 
feel achieved the most recognition. 



Was this 
part of a 
college 
assignment? 
No Yes 



o 
o 
o 
o 



o 
o 
o 
o 



How widely was it 
circulated? 
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2: 
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o 
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o o o o 



o o o o 



o o o o 



o 
o 
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o o 
o o 
o o 
o o 



Number of other 
similar works* 



If published, fill in the 
name of the publication or 
publisher* PLEASE PRINT* 
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Tbis section deals with contests, exhibits, and certain kinds of public performances « 
Answer each question by BLACKENING THE APPROPRIATE CIRCLE after each question* 

If you indicate below that you have engaged in a listed activity, please provide all 
the information about the activity as requested by the columns* If you indicate 



Have you 
engaged in this 
activity? If 
you mark **Yes,** 
fill in the 
rows at right 
No Yes 



In college or prior to applying 
to graduate school, did you: 

1* Build a scientific apparatas or 
device (e*^,*, microscope, 
spectroscope) * 

2* Design or invent a piece of 

machinery, scientific apparatus, 
or electronic equipment* 

3* Work out original solutions to 
mathematical problems (e*g*, 
proofs for theorems or 
propositions not given by the 
instructor or textbook)* 

4* Repeat a known scientific 
procedure or demonstration 
(e*g*, identification of 
elements or biological 
specimens)* 

5* Conduct an original scientific 
experiment * 

6* Collect scientific specimens 

(e*g* , fossils, rocks, microscopic 
slides, photographs of star 
movements) * 



When? 



0) 



o 

<J 

c 
u 
a 



o 



u 

0) 



< 



Was this 
part of a 
college 
assignment? 

No Yes 



With 
whom 
did 
you 
do it 



4U 
O 



o o o o 



o o o o 



o o o o 



o o o o 



o o o o 



o o o o 
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that you did not engage in the activity by marking "No/* go on to the 
next question* 

If you engaged in a listed activity more than once, describe the one that you 
feel achieved the most recognition* 



Did you 
receive 
payment 
for this 
activity? 

■ Ho Yes 



If you engaged in 
this activity in 
a contest or 
exhibit, describe 
the geographical 
area covered by it ^ 



Did you win a prize ? 







O 








4-1 
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■H 
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>^ 




0 


o 




to 


4-J M-l 


O 
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to 






O 


.J 3j 
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2: 
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■H 

4-1 
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<y 
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X 
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O 



a 

4J 

3^ O 

x: -H 
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O 4J 

-H 3-J 
3j -rt 



o 

N 
-H 

3^ 

4J 

3^ 
-H 



Fill in n£ime of the 
contest or exhibit sponsor 
{e*g*, National Science 
Foundation)* PLEASE PRINT 



Number of 
similar 
achieve- 
ments* 



U 
3^ 

a o u 
o c 
ia o H 



o o 



oooo oo oo 



o o o 



o o 



oooo oo oo 



o o o 



o o 



oooo oo oo 



o o o 



o o 
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oooo oo oo 



o o o 
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Section II, cont'd. 



When? 



Ill college oc pcioc to applying to 
graduate school, did your 



7* Give a public musical pecfocmauce* 

8t Accange oc oose music (e*g*j 
folk songs*) 

9* Hntec a literary contest* 

10* Produce ociginal writing (e*g*« 

£ict Ion, nonfiction, poems , plays) * 

II* Enter a photography exUibit oc 
contest* 

12* Publicly display your drawings, 
cartoons, paintings » sculp tuc es, 
or othdC fine acts work* 

13* Entec an architectural contest or 
exhibition with ociginal dtislgns, 
building stcuctuces, oc floor plans 

14* PubJicIy display objects that 
you designed anri ttiade* 

15* Enter a public speakinj; or 
debating contest* 

I6* Publicly pecfor:ii oc choceogcaph 
artistic dancing (e*g*, ballet, 
modecn dance, forei{;n dance)* 

17* Act in a play oc movie* 

18* Dlrnct a play> movie, modern 
dance » oc ballet* 



19* Oelivec a speech. 



Havo you 
engaged in this 
activity? If 
you mack "Yes,*' 
fill in the 
rows at eight 

Ho Yes 



o 
o 



o 
o 



c 
o 



o 
o 

o 
o 
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With 
whom 
did 



0) 

oo <y 

^ ^ Wai5 this 

o iH pact of a 

o o 

o college 

c u assignment ? a> 

U U O 

Q < Ho Yes " <_ 



you 
do it'i 



o o o o o o 

o o o o o o 

o o o o o o 

o o o o o o 

o o o o o o 

o o o o o o 

o o o o o o 

o o o o o o 

o o o o o o 

o o o o o 

o o o o o o 

O o o o o 

o c: o o o o 
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Dld you 
receive 
payment 
for this 
activity? 

No Yes 



o o 

o o 

o o 

o o 



If you engaged in 
this activity in 
a contest or 
exhibit^ describe 
the geographical 
area covered by it 



Did you win a prize ? 
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Number of 
similar 
achieve" 
ments * 



Fill in name of the 
contest or exhibit sponsor 
(e*g*» National Science 
Foundation)* PLEASE PRINT. 
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The questions In this section refer to artistic or scientific objects or products 
you may have produced and for which you may hnve received payment. Answer each 
questlon'by BLACKKHIMG THE APPROPRIATE CIRCLE after each question. 

If you Indicate belov that you have engaged In a listed activity, please provide 
all the Information about the activity as requested by the columns. If you indicate 



Have you engaged 
In this activity? 



If you mark "Yes,** 
fill In rovs at 
right. 



In college or prior to applying 
to graduate school, did you; 



1. Hake your ovn vorks of art 
(e.g. paintings, sculpture) . 

2. Make your ovn handicrafts 

Items (e.g., jevelry, needlevork, 
weat'lng, leather goods). 

3. Design objects for use by 
others (e.g., program covers, 
stage settings, furniture) 

4. Take photographs, movies, or 
glides* 

5. Build musical Instruments 

6* Build electronic equipment 
from your own design (e.g., 
radio, spectroscope) . 

7. Build machanlcal devices from 
your own deolgn (e.g., hydraulic 
pump) . 

8. Dei:iign buildings, boats, toys, 
efjulpment, or automobiles. 

9. Design and construct clothing. 

10. Design Interiors of rooms and 
buildings . 



Mo Yes 



o 
o 



o 
o 



o 
o 



When? 
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Was this part 
of a college 
assignment? 

X£S 
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o o o o 
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o o o o 



o o o o 
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that yoii did not engage in t\\o activity by marking "No#" go on to the 
next ciuestlont 

If you engaged in a listed activity more than once# describe the one tlmt you 
feel achieved thi* most recognition* 



Have you 
ever sold 
any o£ these 
products? 
If "Yes/" 
answer rows 
at right* 



GeographlcaJL area 
from which you 
drew your customers^ 



No 



Yes 
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Type o£ product 
(cer^im ic^^ , etc* ). 



Numbers oC times 
you sold similar 
items before you 
applied to graduauf. 
school. 
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This seclion deals villi certain special |)<jid or unpaid activities such os jobs, 
vciunteer workj oiilitarv activiti*js tli^it you may have ciigagnd in and/or offices 
yQo iday htwe held during college or b*j(ore a|>plying to graduate school. Please 



I, Have you held a joh chat taught you an important skill? 

2- Have you received a job promotion for outstanding performance? 

3, llav<? yo^ had major re?'ponsibi 1 i ty for ai^other person (e-g-, custodial 
care, eruer^ency squad, parenting)? 



4, Ha\f*j you h*?ld o position in a group that tried to influence social institutions? 



5- Have you been au at-tivc member of a group in which you had to interact closely 
with other people (e<g<, youth counseliuf^, camp counseling, church activities, 
conmuui ty organizat ions) ? 

0- Have you i;up*7rvisod a group of volunteers (e<g<, in a political campiiign, 
neighborhood program for children, church organi i:at ions)? 



7< lla*^e you raised or matiagcd money for au organization or project (e<g* , community 
(nud drivo, served a:? treasurer of a club)? 



8- llnv<* you won an athletJc aw^ird? 



9- IJ.r^c you p-irt ic J paL'^fl in athleljcs (e-fi-, co^iched, managed, or f^laycd on a team 
or in a rournam^nt)? 



10. Movc you been \o a major class uffice (<>.g< , president, vice pr<^sident, 

treasurer)? 



II* Have you been appointed or elected a member of a college-wide student group, 
such as student council or student senate? 



12< Have you been an elected officer in a conmunity social group? 



13< Ha*/e you served on a nt ^idenr-f acnU y coimnittce? 



ERIC 




blacken completely ow circle iiQ'^l to your answer lor eacli question. If 
you mark any "Yes'* *Tii^ti.'er^> , \y\e*ino [ill ii\ the requested information in 
ter«i!5 of the nctivity or role that you feel is most sigoificaat. 



Ko Yes 



o o 



o o 



If you m<Trk'Ml "Yes," please 
fill in the 



Nature of f;Ui 1 1 



Position you were promoted to 



Nature of responsibility 



N'ature of i^roup 



Hnture of group 



Nature of group 



Name of nrg*inization or project 



'Name" oF" sport or activity ^ auar3' 



"Eamc of"spoft:"or activity 6 nature ot 
part ic ipat ion 



Posi t ion held 



Pos i t Ion held 



CUih or orj^ani zat ion 



CoinmU t oo 
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It. Nave you served as a research or laboratory assistant cither in college 
or outside of colle;;c? 

15, Have you served os a tutor Cor someone? 

16* Ilnve you started your own business? 

17^ Have you actively f^art icipated in a college, community, or religious 



service organization or j>rogr^ni (e,g,, tJcrved as chairman of a charity 



18. Have you participated in any cictivities in tlie arts, human it- ies, or 
sciences that were not covered by this rin^stionaire? 



drive)? 




ERIC 



-47- 



No Yes 



If yo.. .lorkrd "Ves,'* pio^ise 
fill ill the * t * * 



o o 



Content area 



Subject 



*lypo of husiness 



Sponsoring orjsanisatLon 



Acti^rity or achie^renient 
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Ple^isc choose up to llireo txp^^i leiicos tUat you consider liighly SLgnificanl in your 
pre|j<)rat ion tor gratluiit*: study^ or tliot gave you llie gru^test sense of accoiupl i slimeni . 
whether or not they <ippL<ar in tlie preceding lists. Then, pU^ase answer th<? following, 
questions for each one. 

Accoinplishnie n t 1 



I. Briefly describe the o;tpcMience, providing specific details about where and when 
it occurred and how *ind wliy it was initi<ited. 



2 . U1i.it ski 1 1( s) , coin[>i*tenc^ (s ) > knov:ledge , or spr>c ial accomplishnient{ s) resulted 
from the experience tiescribed nbovo? 



3. Can you give any evidence of the qii^ility or level of attainment that thfs 

;icli i<*veiiicnt reprer*t'nt f o , pr i zp, cei t i [ icatc , letter , recogiii t ion , iinp*ic t 
on individual^)? 



4. Khjt makes the ;;kilU, cotiipeicncet or knowledge resulting froni the experience 
or any ar>pt*ct of the *?xperioncp relevant or prerequisite to your f^^rnduate 
educat ioui\ I Jio.il ? 



'i. Give the naiiic;; jiid locntion.s of thore individuals that are acquainted with your 
wci U 1 11 th i s arf;i . 
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Accomplishment 2 " 

Iv Briefly describe the experience, providing specific details about where and 
when it occurred and how and why it was initiated. 



What skillCs), competence (s), knowledge, or special accomplishment(s) resulted 
from the experience described above? 



Can you give any evidence of the quality or level of attainment that this 
ach ievement represents (e.g., prize , cert i f icate, letter, recognit ion » impact 
on individuals)? 



4* What makes the skills, competence^ or knowledge resulting from the experience 
or any aspect of the experience relevant or prerequisite to your graduate 
educational goal? 



5, Give names and locations of those individuals that are acquainted with your 
work in this area* 
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AccomplishmenE 3 



Briefly describe the experience, providing specific details about where and 
when it occurred and how and why it was initiated* 



What skiUCs), competence Cs) , knowledge, or special accomplishraentCs) resulted 
from the experience described above? 



3* Can you give any evidence of the quality or level of attainment that this 

achievement represents (e*g. , prize, cert if icate, letter, recognition, impact 
on individuals) ? 



What makes the skills, competence^ or knowledge resulting from the experience 
or any aspect of the experience relevant or prerequisite to your graduate 
education^j. goal? 



Give names and locations of those individuals that are acquainted with your work 
in this area* 
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]-V^il>i,i'. ton of Mu; Tnvonf-oiv . tivitjt;:: ant! '\cvoinpHshmai;tj> 

We wdtiL to make this survey as accurate and f;jir as possible. You could help 
us do this iE you spend a few minutes looking back over the questionnaire with 
the following questions in mind: (1) How do you feel about the whole 
quesr.ionnairc? (2) Were there any <|ucstions tliat caused you trouble because 
they were unclear, difficult to answer, or asked for details you could not 
provide? (3) Did any of the instructions cause you problems because they were 
unclenr or confusing? 

1* Did you understand tlie purpose of the inventory? 

^ Yes o Only generally, but I 

o No, not really "^^^^ 

be used 



2* About how long did it take you to complete the survey? 
^minutes 

3* If yon were filling out the questionnaire as an applicant to graduate school, 
U'ould yon consider the time needed to complftte it to be time well spent? 

^ Definitely ^ No, with reservations 

Yes, with reservations ^ Definitely not 

Comments: 



^1 . Wonid you like to have :i snfvey like this available as part of routine 
;i[>plic:ition procedures? 

o Definitely ^ No, with reservations 

o Yes, with reservations ^ Definitely not 

Comments: 



5- Do you feel that the inventory allows you to present an accurate picture of 
your activities and accomplishments? 



Yes No 
Comments : 
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Xa the .';jf.jc<j btiloJ i;J^^OJ*e iUl tlio '^'m numlior of a<iv '^uostion lhal nouvcd 
you trouble, indicate the nature of the trouble, and provide any comments 
about how to improve the question* 



Nature of Problem 
(chock as many as apply) 




Item 
number 


Unclear 


Hard 
to 

answer 


Asked for 
details that 
were hard 
to remember 


Conunents 








o 
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o 
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o 


o 


o 





7. 



Did any of the instructions create problems? for you? If so, please list 
the page and section, and describe the problem (e^g*, confusing, unclear, 
otc.)^ Any suggestions for improvements would be especially welcome* 



Page/Section 



Problem 



8* Would you be willing to be interviewed about the inventory by an ETS staff membi 
o Yes o No 



If yes, huw w^ c:oiitact you? 



1 



I'lione number; 
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